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(54) Apparatus and metttod lor attribute indentification In color reproduction devices 



(57) An apparatus and method ktentify at least one 
attribute of an article for use in accuratety reproducing 
the article. The apparatus includes at least one detector 
(210) having an array ol cells. Al least one cefl 
(213.215,217), in the detector array, the sensor cell, is 
provided with an extra cotored coatffig or is painted with 
an extra cok>r. When the artic:le is scanned by the de- 
tector (210), the at least one sensor cell will read a dit- 
ferent color value from the other cells due to the extra 



coaling applied to it. The cokw that the at least one sen- 
sor cell wouki have output without the extra coating is 
Interpolated from the detection results of the neighbor- 
ing cells. This color and the color actually detected by 
the at least of>e sensor cell are then input to a controller 
(220) which determines the at least one attrtoute of the 
scanned article using a model, such as a neural net- 
work, an expert system, a fuzzy logic model, and the 
Bke. The controller (220) performs appropriate process- 
mg based on the at least one determined attribute. 
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Description 

[0001] The ffivention is cfirected to an apparatus and 
method for attrftwjte identification. More specrtkralty. the 
invention is directed to an apparatus and method which 
identifies at teast one^ attribute of an article so that the 
article may t>e accurately reproduced. 
[0002] Color detection in reproductbn devices, such 
as cdor scanners and photocopiers, is generally known 
in the art As illustrated in Fig. 1. a conventional color 
scanner includes a light source 100 which illuminates 
an image on a medium 110. The li^t beam 102 that g 
incident upon the image is reflected and imaged by an 
optical system 104 down upon a CCD sensor 120. 
These conventional scanners use many different meth- 
ods and apparatus to detect the colors of the image. 
[0003] For color scanners to properly corwert the 
color image to electronic striate, the color scanners 
need to simutate the color response of the human eye. 
This is conventionaDy done by scanning the color miage 
with the three separate color channels, usually red. 
green and blue channels. 

[0004] As shown in Fig. 2. the CCD sensor 120 of the 
conventional color scanner has three rows 1 22. 1 24 and 
126 of detectors over which three different color filters, 
a red filter R, a green filter G, and a blue filler B. are 
placed. Thus, the color scanner has separate areas of 
the serisor tor sensing particular color components ot 
the image bearig scanned. 

[0005] Another approach taken by the prior art is 
shown in Fig. 3. In this device, the CCD sensor 1 20 does 
not have any color filters on the rows 122. 124 and 126 
of the detectors. Instead, a cotor wheel 1 30 is placed in 
the optk3l path of the light beam 102 between the light 
source 100 and the CCD sensor 120. The cotor wheel 
1 30 contains three filters, a red filler 1 32. green filter 1 34 
and blue filler 136. The cokx wheel 130 is rotated 
through the optcal path to provide the proper cokx sep- 
aralton. This device requires three scans of the image 
in order to obtain information on all three colors. 
[0006] In another approach, as shown in Fig. 4. a con- 
ventior>al color scanner uses three filters, a red filter 1 42, 
green filter 144 ar>d blue filter 146. These fitters are 
moved into and out of the oplcal path of the light beam 
102 between the light source 100 arxl the CCD sensor 
120. By sfiding the fillers 142, 1 44 arxl 146 into and out 
of the optical path, information for each color of the im- 
age can be obtain in three scans erf the image. 
[0007] However, since the cofor filters of conventional 
scanners do not exactly match the spectral response of 
the human eye. only an imperfect conversion from the 
scanner output to a colormethc response (human eye) 
can be obtained. For accurate cotor representatton. it is 
necessary to have a cotor scarvier with a cotor response 
that matches the human eye. If a color scanner can ac- 
curately match the cotor response of the human eye, the 
color scanner can create an electronic file that com- 
pletely describes the color of an object as seen by the 



human eye. Thus, the image can be reproduced accu- 
rately by a printer, a photocopier, or a display. 
[OOOq Recently, an approach has been suggested in 
U.S. Patent 5,642, 1 97 to Tuhro el aL, which is shown in 
5 Fig. 5. Tuhro suggests using a filter 150 in addition to 
the red. green and blue filters 1 32-1 36 of the color wheel 
130 to obtain corrected cotor values. Specifically, 
Tuhro's approach requires an initial scan of the image 
using a set of red, green and blue filters. arxJ then sub- - 
10 sequent scans using the red, green and blue filters with 
the additional filler 150 placed in the optica) path. The 
addittonal fitter 1 50 provides offset cok>r values that may 
be used to calculate corrected cotor values. In ar>other 
embodiment of Ti^ro, shown In Fig. 6, tfie cotor wf>eel 
'5 1 30 is equipped with an additional red filler 1 33, an ad- 
dillona! green filler 135 and an additional blue filter 137 
to provide the offset values. This approach requires 
many adcSiorial scarts of the image, for example up to 
six scans of the bnage, thus slowing down the reproduc- 
^ tton process. 

[0009] Thus, It would t>e beneficial to have a device 
that can accurately match the spectral response of the 
human eye without requiring additional scans of the im- 
age. 

2S [OOlQf] To this end, it has been determined that, if cer- 
tain attrftnjtes of the scanned article can be detected, 
approprrate processing can be performed to accuratefy 
reproduce the scanned article. For example, if the me- 
dium of the scarmed article can be determined, appro- 

30 priate cotor correction can be applied to the scarv^ed 
cotor data performed to reproduce the article in true 
cotor, i.e., the cotors perceived by the human eye. 
[0011] This invention provides an apparatus and 
method that determines at least one attribute of an arti- 

35 cle based on the cotors detected using either a modified 
detector or an addilkxial detector during scanning of the 
article. Once the at teast one attribute is determined, 
various processing may be performed based on the at 
least one attrft>ule in order to accurately reproduce the 

<o scanned article. 

[001 2] In a preferred errrtxxiiment, the at least one at- 
tn'bute is the medium of the scanned article. By deter- 
mining the medium of the scanned article, the true cotors 
of the article may t>e determined usffig appropriate cor- 

^ rection values obtained throu^ cateulatton. a lookup ta- 
ble, or the tike. 

[0013] The £^>paratus includes at least one detector 
havHig an array of cells. One cell in the detector array 
is provided with an extra cotored coating or is painted 
>o with an extra cotor. The coated or painted celt is the sen- 
sor celt. 

[0014] When the article is scanned by the detector, 
the sensor cell will read a diflerent cotor value from the 
other celte due to the extra coating applied to it. The 
^5 cotor that the sensor cell would have output without the 
extra coating is interpolated from the outputs of the cells 
neighboring the sensor cell. This cotor and the cotor ac- 
tually detected by the sensor cell are then input to a con- 
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trolter which determines at teast one attribute of the 
scanned articte. such as the medium of the article^ the 
device that tonmed the article, and the fike. From th^ 
attribute, in one embodiment, the controller determines 
the appropriate correction for the cofor values detected 
by the other ce&s so that accurate reproduction of the 
article can be performed. 

[0015] These and other features and advantages of 
this invention are descrft>ed in or are apparent from the 
following detailed descr^tion of the prefen^ed embodi- 
ments. 

[0016] The preferred emt>odiments of this invention 
wQI be described \n detaD, with reference to the following 
figures, wherein: 

Fig. 1 is a block diagram of a conventional cotor 
scarvier; 

Fig. 2 is a detailed diagram of the CCD of the con- 
ventional color scanner of Fig. 1 ; 
Rg. 3 is a block degram of a second type of corv 
ventkytal color scanner. 

Fig. 4 is a bkx:k digram of a third type c4 conven- 
tional cok>r scanner. 

Fig. 5 is a bkx:k daaQram of a fourth type of converv 
tkxial cok>r scanner. 

Fig. 6 is a block diagram of a modifcation of the 
fourth type of conventional cokx scanner; 
Fig. 7 is a block diagram of the reproduction system 
of this inventksn; 

Fig. 8 IS a detailed diagram of the detector of Fig. 7; 

Fig. 9 is a diagram of a neural network of one errv 

bodiment of this tnventkxi; and 

Fig. 10 is a fk>wchart showing the operation of this 

invention. 

[0017] Fig. 7 iltustrates orte errtbodtment of a scanner 
according to this invention which uses an additional 
coating to one cell of the detector. This embodiment will 
be explained with regard to an image scanner. However, 
the concepiB of this invention may be used with any de- 
vice that reproduces an article by scartning arKf detect- 
ing color values of a scanned ancle, such as a cotor 
photocopying devce. computer or the like. 
[0018] In this emtxxfiment of the inventk)n. tt>e light 
source 100 illuminates the image on the medium 110. 
The light reflected from the image on medium 110 is im- 
aged by an optical system 200 arxf falls incident on a 
detector 210 whk:h detects cok>r values from the inci- 
dent light. The detector 210 may be any device \ha\ is 
capable of detecting cok>r values from incident light, 
such as a CCD. a fuD width array (FWA). or the like. 
[001 9] These cokx values are then provided to a con- 
troller 220. The controller 220 provides these values to 
a nxxtel 230 which determines at teast or>e attrtoute of 
the image based on the color values detected. The mod- 
el 230 then provides the at least one attribute to the con- 
troller 220. which then performs application specific 
processing based on the at least one attribute. 



(0020] In a preferred embodiment the appDcation 
specie processing includes determining correction val- 
ues for correcting the detected color values based on 
the at least orm attrftHrte of the image on the medium 

5 110. The controller 220 obtains these correctkxi values 
by cak:ulation. a kx>kup table, or the like and applies 
them to the detected color values. 
[0021] The controller 220 then outputs the corrected 
cok>r values to a reproduction devk:e 240 for use in re- 

10 producing the image. The reproduction device 240 may 
be any devk» that is used to reproduce a scanned arti- 
cle, such as a printer, a photocopier, a display or the like. 
[0022] Figure 8 shows a detailed dia^am of one em- 
bodiment of the detector 210. The detector 21 0 includes 

IS three rows 21 2, 21 4 and 21 6 of cells 21 1 . Each row 21 2. 
214 and 216 of the celts 211 detects a different color 
from the irtckfent light due to red, green and blue filters 
R, G and B. Thus, the top row of ceRs 21 2 of the detector 
21 0 detects red f^, the mkJdle row (4 cells 21 4 detects 
^ green light. arKi the bottom row of ceDs 21 6 detects blue 
fight. Each cell 211 provides color values for the light 
that falls irtctderit to that cell 

[0023] One cell in each row 212, 214 and/or 216, re- 
spectively, is a sensor cell 213, 215 and^or 217. Each 

2S sensor cell 21 3. 215 ^d/or 217 has an additkxial filter- 
ing color applied to it. These additional filtering cotors 
may be applied by applying an additkinal coating to he 
sensor cells 213, 215 and 217, by paviting the sensor 
ceDs 21 3. 21 5 and 21 7. or the tike. In general, any meth- 

30 od for applying the additional filtering colors to the sen- 
sor celts 213. 215 and 217 can be used. 
[002^ When fight falls incident on the sensor cells 
21 3. 21 5 and/or 21 7, the cok>r value obtained from tftese 
sensor cells wiQ be different from the cobr value the sen- 

3S sor celb wouU have detected had the add&kxial filtering 
cok>r5 not been applied to the sensor ceOs. Hir example, 
if the cokx values that woukJ have been detected by the 
sensor cells 21 3. 215 and 21 7 are R, G and B, the cok>r 
values actually detected tiy the sensor cells 213. 215 

40 and 217, respectively, are R, G' and ff. 

PX)25] The values for R.G. B and FT.G* and B* output 
from the nonnal cells 211 of the rows 21 2. 214 arKi 216. 
andtheserisor cells2l3, 215 and 217, respectively, of 
the detector 21 0 are riput to the controller 220. The con- 

4S troller 220 then determines the expected R. G and B val- 
ues that the serisor ceOs 21 3. 21 5 and 21 7, respectively 
woukl have detected but for the additior^l tittering 
cok>rs. 

[0026] The color values that the sensor cells 2 1 3. 21 5 
so and 217 woukl have detected but for the additional fil- 
tering colors can be determined by tnterpolatvig the 
color values obtained from the cells 211 that neightxx 
eachof the sensor cells 213, 215 and 217. For example, 
the expected cobr value for the sensor cell 213 en the 
55 top row 212 of the detector 210 can be obtained by \n- 
terpolating the cotor values of the cells 218 and 21 9 of 
the top row 21 2 adjacent to the ser^sor celt 213. 
[0027] The cotor values R. G. 8 and R*. G* and B" are 
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then ffiput to the model 230. The model 230 can be any 
model useable to determine at least one attribute of the 
image from the R, G, B and FT, G' and B* values. For 
example, the model 230 can be an expert system model, 
a fuzzy logic model, or the like. In a preferred embodi- s 
ment, the model 230 ts a neural netvvork. 
[0Q2S| Fig. 9 shows the model 230 tnr^lemented as a 
neural network 250 as or>e embodiment of the attribute 
identtficatton apparatus accordirtg to this invention. The 
neural network comprises an input layer 260, an inter- io 
mediate layer 270 and an output layer 280. The input 
layer has sbc nodes 261 -266 connected respectively to 
the R. G. 8. R*. G' and BT outputs from the controller 220. 
Each of the sbc nodes 261 -266 is connected to each of 
the five nodes 271-275 of the intermediate layer 270. is 
Each of the five intermediate rxxtes 271-275 are con- 
nected to each of the three output nodes 282, 284 and 
286 of the output layer 280. The output nodes 282. 284 
and 286 each output a value based on the values re- 
ceived from the intermediate nodes 271-275. The val- 20 
ues are input to controOer 220 whch uses these values 
to identify at least one attribute of the scanned rnage. 
These values, for example, may be binary, alphanumer- 
ic. Boolean, or the like. 

[0029] The neural network 250 is trained using known 
methods for training a neural networlc. on known data to 
obtain the weight for each of the links conriecdng the 
input nodes 261 -266 to the intermedfeite nodes 271-275 
and the finks connecting the rxxJes 271-275 to the out- 
put nodes 282. 284 and 286. Based on these weights. 30 
the output rKtdes 282. 284 and 286 output data A,. A2 
aruJ uxTicatKre of at least one attribute of the scanned 
image. For example, the attribute may be the medium 
on which the image is formed, the type of device that 
formed the image, and the like. 35 
[0030] In a preferred embodiment, the attribute is the 
medium type on whnh the cnrtage is forrrted. In this em- 
bodiment, the output node 282. 284 or 288 having the 
maxirrujm output value is selected and a correspcrKf trig 
code ^at designates the medium is obtained from the 40 
selected output node. This same code is stored in a 
merrxxy {rvA shown) that ^ accessble by the controller 
220. For example, the code "100* may indicate that the 
medium is photographc nriaterial, the code "OIO* may 
indicate a Irthographcrr^dium and the code "001* may ^ 
irxficate an Inkjet medium. Thus, from the output dt the 
neural network 250. the conlroller 220 checks the output 
of the model 230 against the codes stored in memory to 
determine the medium on which the image is formed. 
[0031] Basedon the determination of the medium, the so 
controller 220 can correct the delected coUx values lor 
all the cells 211 using predetenrraned correctkxi coeffi- 
cients, in order to obtain a true reproduction of the 
scanned amage. These correction coefficients may be 
cateulated using predetermined equations or functions, ss 
compiled in one or more correctk^n tables and stored in 
a memory as look-up tables, or the like. 
[0032] This same process can be performed for an 



embodrrrrent in whch the attribute obtained from the 
neural network 250 is the type of devkre that teamed the 
mnage. In this embodimwrt. the codes '^00\ •OlO' arwJ 
TX)1* desigrtate different image forming devces such 
as an inkfet pr^iter. laser printer, thermal printer, photo- 
copter, and the like. 

[0O33] As the article is scanned, if it includes more 
than one cok>r (for example, an image having a blue sec- 
tion and a green section), different cotor values win be 
detected by the cells when scanning the different sec- 
tions of the image. As a result, different values for the 
attribute may be obtained from the model 230. Thus, 
when scanning rows in the blue section, it may be de- 
termined that the attribute designates a photographk: 
mediunrt However, when scanning rows in the greed 
section, the attribute may be determined to de^gnate a 
lithographc mediura 

[0034] In order to accurately determined the attrft>ute 
of the scanned artk^le in the above situatbn. the control- 
ler 220 of Rg. 7 may perfomi statistk:al analyste on the 
determined attributes for each scan of the artkHe. This 
statistical analyst may irK^lude averaging the attribute 
values obtained from the scans, majority rule, arxi the 
like. For example, if the article consists of an image hav- 
ing 10 rows <10 scans), the rrtodel 230 will provide 10 
values for the attribute of the article, each one corre- 
sponding to a row of the artcle. Thus, if scanning the 
first 7 rows provkies 7 determinations that the attra>ute 
is photographic material and the remaining scans of 
rows 8-10 provkte a different determinaton, the nr^ajority 
rule would provide the outcome that the medium is pho- 
tographic material In this way. higher accuracy and 
more robust cobr correctkin can be obtained. 
[0035] Rgure 1 0 is a fk>wchart of the operation of the 
scannirig apparatus described atxTve. The scanning 
process starts at step SI 00 and continues to step S200. 
In step S200. one row of tf>e artcle is scanned to obtain 
detected cokx values from the detector 210. This scan 
provxtes the R G and B color values of the entire row 
and the R. G* sa\d B' color values for the sensor cells 
213. 215 and/6r 217 that are input to the controller 220 
to determtne the correction values. Control then contin- 
ues to step S300. 

[0036] In step S300. the cobr values that the sensor 
ceDs 213. 215 and 217 wouM have detected but for the 
additional filtering cokx are determined. This isdorte for 
the sensor cell 21 3, in one ennbodiment. by interpolating 
the cotor values detected by neighboring cells 218 and 
21 9- The corresponding neighboring cells to the sensor 
cells 215 and 217 in the rows 214 and 216 are similarly 
used to interpolate the color values for the sensor cells 
21 5 and 21 7. Control then proceeds to step S400, where 
the two sets of cotor values R. G, B and R*. G'. B* are 
used to determine at least one attritHJte of the scanned 
article. As described at>ove. this attribute may be the 
medium of the artcle. the devce that formed the artcle, 
and the tike. 

[0037] Then, in step S500. coneclkxi values for the 
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detected color values are determined based on the at- 
trft>utes determined in step S400, These correction val- 
ues may be calculated, obtained from a correction table 
in memory, or the like. These correction values are then 
used to calibrate the R. G and B values of the entire row 
provided by the detector 210 so that the color values 
obtained from all the cells 21 1 provide a true color rep- 
resentation of the scanned article, 
[003S| Lastly, in step S600. the process may be re- 
peated for the next row of the scanned article, otherw^, 
the scanning has finished with the bottom row of the ar- 
ticle and the process continues to step S700, where the 
process ends. 

[0039] While this invention has been described with 
reference to a color scanner, the invention is not limbed 
to such an embodiment The invention may be practiced 
on any color reproduaion device. For example, the in- 
vention may be practiced with a color photocopier 
[0040] Furthermore, this inventk)n has been de- 
scribed wherein, after the article's attrd>utes are deter- 
mined, tf»e processing performed is color correction. 
However, this invention is not limited to such processing. 
For example, the processing may include determining 
optimum printhead positioning, determincng printer 
codes, determbiing paper thicknesses, and the like. 
Such processing may be facilitated by compiling empir- 
ical data with regard to various scanned articles arxi the 
coH'esporKting printhead poedion. printer codes, paper 
thk:knesses, etc. that provide the optimum result in re- 
producing the scanned article. This inlormatfen may be 
contained in the memory descrt>ed above and ac- 
cessed based on the attr^e codes output by the model 
230. 

[0041 ] Additksnally, this invention is rK>t intended to be 
limited to the particular colors descrit>ed at>ove. WhOe 
the preferred emixxltment uses red. green and blue 
scartning colors, these colors may be replaced by other 
cokxs depending on the partcutar applicatkyi. Thus, 
any corr^'nation of colors may be used without depart- 
ing from the spirit and scope of this invention. 
[0042] Furthemrtore. this invention has been de- 
scrd>ed with reference to a skigle detector havtf>g three 
rows of cells to detect the three colors, red. green and 
blue. However, this onvernkxi is noH limited to such an 
arrangement The detector nrray have more or fewer 
rows of cells for detection of the cok>r values of the ar- 
tk:le. Moreover, additkxiat detectors may be used, each 
detecting only one color from the article. 
[0043] Also, rTK>re than one set of sensor cells may be 
used in one row. Thus, it is possible to increase the de- 
tectk3n accuracy arul/or to detect cases when different 
attributes occur skie-by-side on one page. For example, 
if a page Includes an image printed by a laser printer 
axvi text printed by a but>ble jet printer, the additbnal 
sensor cells would provide additk>nal detectkxi accura- 
cy of the differing attributes. 

[0044] Further, this invention may empby an addition- 
al detector or additional row of cells having the additional 



filtering cobr applied rather than applying the filtering 
cotor to the sensor cells 213. 215 arwltor 217. The ap- 
paratus contimies to operate as described above, only 
the R, G' and B* values wouki be obtained from the ad- 
ditional detector or row of cells. 



Claims 

1. An apparatus for reproducing an article, compris- 
ing: 

a light source that illuminates the artble; 
at least one detector having at least one row of 
cells with at least one filtering cok>r applied to 
the cells. wherevY each row has at least one 
sensor cell that has an addilksnal filterong color 
applied to it and the cells and the sensor cells 
output coksr values detected from tight reflected 
from the aitcle; arul 

a controller, that determines at least one at- 
trft>ute of the article from the cok)r values of the 
cells and sensor cells. 



2S 2. 
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The apparatus claim 1. further comprising: 

a model that outputs an kfentification code 
that identifies the at least one attr&ute of the artk:le 
based on cok>r values detected by the sensor cells 
and cokx values that the sensor celts woukJ have 
detected but for the additbnal filtering color 

The apparatus of claim 2, wherein the controller de- 
termms sd least one attrbute of the article from the 
values of the cells and sensor cells using one of av- 
eraging the kientifk^ation code with prevkMisly out- 
put klentifk^atkxi codes arKi d^ermintng majority 
rule ol the ktent3k:atkxi code with prevk>usly output 
kJentifk:at»n codes. 

The apparatus <rf claim 2, wherein the controller de- 
termines the cok>r values dt the sensor cells that 
wouki have been detected but for the additional fiF 
tering cok>r by interpolating the cok>r values of celts 
neigtiboring the sensor cells. 

The apparatus of claim 1 . wherein the at least one 
attrft)ute is at least one of a medium of the article 
and a devk:e that formed the artcle. 



so s, A method of reproducing an artcle, comprising: 
illuminating the article; 

detecting cokx values from light reflected from 
the article, wherein the cok>r values include 
^ cok>r values detected by normally filtered de- 

tectors and offset cok>r values detected by de- 
tectors having at least one additksnat filter; 
determining at least one attribute of the article 
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based on the detected cx>lor values; 
determining correction values for ttie color val- 
ues d^ected based on the at least one deter- 
rruned attrft>ute; and 

correcting the color values in accordance with s 
the detennined correction values. 

7. The method of clatm 6, wherein the at least one at- 
tn'bute of the article s d^ermoned by inputting the 
detected color values into a model. io 

8. The method d( clarm 7. wherein the model is one of 
a neural network model, an expert system nKxJel 
and a fuzzy logic model. 

15 

9. The method of claim 6, wherein the at least one at- 
tribute is at least orrn of a medium of the article and 
a device that formed the article. 

20 
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